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ABSTRACT 

Motivated  by  the  independence  of  the  mean  and  the  variance  of  a sample 
from  a normal  population,  Mudholkar  and  Lin  [4]  proposed  a statistic  Z for 
testing  the  composite  hypothesis  of  normality.  This  test  is  based  on  the 
Fisher  transform  of  the  product  moment  correlation  coefficient  r between 
and  Y^,  where  X^,  i=l,  2,...,n  is  the  random  sample  and  Y^  is  the  Wilson- 
Hilferty  transform  of  the  sample  variance  with  the  i^  observation  deleted 
from  the  sample.  In  this  note  we  show  that  r and  Z both  are  asymptotic- 
ally normally  distributed.  It  is  then  demonstrated  that  the  Z-test  of 
normality  is  consistent  against  any  asymmetric  alternative.  The  large  sample 
null  distribution  of  Z is  used  to  reconstruct  the  expression  for  the  finite 
sample  estimate  of  the  variance  of  Z which  agrees  with  its  asymptotic  value. 
Fortran  and  APL  routines  for  computing  the  statistic  and  its  P-value  are 
given. 
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ASYMPTOT IC  BEHAVIOR  OF  THE  2-TEST  FOR  NORMALITY 

1.  INTRODUCTION 

Let  X^,X0,...,X  be  n independent  identically  distributed  random 
variables  with  distribution  function  F ( * ) , and  consider  the  composite  hypothesis 

Hq:  F(x)  = 4>(  ) , -«  < m < « , o > 0 , (l.l) 

where  <!>(•)  is  the  standard  normal  distribution.  Mudholkar  and  Lin  [4], 
motivated  by  the  independence  of  the  mean  and  the  variance  of  a sample  from  a 
normal  population,  proposed  using  the  Fisher  transform  2 of  the  product  moment 
correlation  coefficient 
n 

l (X.-X)(Yi-Y) 

r 3 1=-  ■ ■ - — ' - (1.2) 
n _ 7 n _ 7 

l (x.-xr  I (Y.-Yr 

i=l  i=l  1 

1_ 

between  X and  Y.  , where  Y.  * { [ £ X?  - ( £ X . ) 2/ (n-1) ] /n}3 

1 jH  J iH  ] 

is  the  Wilson-Hilferty  transform  [6]  of  the  sample  variance  with  the  i1"*1 
observation  deleted  from  the  sample,  as  a statistic  for  testing  normality. 

They  show  that  even  in  small  samples  the  null  distribution  of  Z is  near 
normal  with  mean  zero.  A Monte  Carlo  experiment  was  conducted  to  obtain 
the  variance  and  the  excess  of  Kurtosis  of  Z for  various  values  of  the  sample 
size  n.  From  these  using  weighted  regression,  it  was  proposed  that  we  may 
take 

°n  = °n(Z)  = (-591730  + -143559  n-. 002235  n2+. 000016  n3)"1  , (1.3) 

Y2,n  = y2  n(Z)  * -H-697157/n  ♦ 55.059097/n2  , 


(1.4) 
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as  the  finite  sample  estimates  of  the  standard  deviation  and  the  excess  of 

Kurtosis  of  Z,  respectively.  Even  though  (1.3)  gives  a good  estimate  for 

on(Z)  over  the  range  of  the  simulation,  it  suggests  that  asymptotically  it 
3 

is  0(l/n  ).  In  this  note,  we  show  that  r and  Z both  are  asymptotically 

normally  distributed.  It  is  then  demonstrated  that  the  Z-test  of  normality  is 
consistent  against  any  asymmetric  alternative.  The  large  sample  null  distri- 
bution of  Z is  used  to  reconstruct  the  expression  for  which  agrees  with 

its  asymptotic  value.  Fortran  and  APL  routines  for  computing  the  statistic  and 
its  P-value  are  given  in  Appendix. 

2.  THE  LARGE  SAMPLE  THEORY  FOR  THE  Z-TEST 

Consider  the  problem  of  testing  the  composite  hypothesis  that  a sample 
^l’^2,'”‘,^n  szze  n zs  ^rora  a normal  population.  It  is  well  known,  (e.g., 

Cramer  (1946),  and  Kagan,  Linnik  and  Rao  (1973)]^  that  the  hypothesis  is  true 
if  and  only  if  the  sample  mean  X and  the  sample  variance  are  indepen- 

dently distributed.  Thus  a test  for  the  independence  of  X and  S2  is 

also  d goodness-of-fit  test  for  the  normality.  The  apparent  limitation  that 

2 

we  have  only  one  (X,S  ) for  testing  the  independence  of  the  pair  can  be 

1 

circumvented  in  many  ways.  The  most  convenient  of  these  is  to  consider  the  n 
means  and  the  corresponding  variances  computed  from  the  n samples  obtained  by 
deleting  one  observation  at  a time.  Even  though  the  n pairs  so  obtained  are 
not  independent,  they  can  be  used  to  estimate  the  extent  of  the  dependence 
between  the  mean  and  the  variance  of  samples  from  the  population.  Because  of 
its  simplicity,  we  wish  to  use  the  product  moment  correlation  coefficient  as 
a measure  of  the  dependence. 
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Now  the  test  based  upon  a product  moment  correlation  coefficient  is 
appropriate  for  testing  independence  in  a bivariate  normal  distribution. 
However,  one  of  the  marginal  distributions  in  the  present  case,  the  distribu- 
tion of  variance,  is  nonnormal  even  if  the  parent  population  is  normal.  This 
can  be  remedied  to  a considerable  extent  by  applying  the  famous  Wilson  and 
Hilferty  (1931)  cube  root  transformation  to  the  n variances  in  order  ap- 
proximately to  normalize  them.  Because  of  its  invariance  with  respect  to 
changes  in  scale  and  origin,  the  correlation  coefficient  between  the  n sample 
means  and  the  cube  roots  of  the  corresponding  sample  variances  mentioned  above, 
equals  the  correlation  coefficient  r ■ corrfX^  , where 

Y.  - {£■  [ l X2.  - ( l X )2  / (n-1)  ] }1/3  i - 1,2 n . (2.1) 

1 n j+i  j jf*i  } 

2 

Abnormally  large  values  of  r would  cast  doubt  on  the  normality  of  the  X's. 


Asymptotic  Distribution  of  r.  Without  any  loss  of  generality,  suppose 

that  X.,  Xj , . . . , Xn  are  independent  identically  distributed  random  variables 
2 k 

with  EXj  * 0,  EX^  * 1 and  denote  ■ EX^  , k * 3, 4, 5, 6.  In  order  to  under- 
stand the  large  sample  distribution  of  the  coefficient 
n 


(2.2) 


We  note  that  as  n -*■  ® 


1 11  _ 2 

~1  (Xi  - X)  -*■  1 in  probability  and  examine  the  large 
ni»l  1 
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sample  behavior  of  the  other  two  terms. 

Lemma  2.1.  As  n -*■  00 

- 2/3  ’ (Xi  ' X)2  1 

(a)  Y.  - Y - S2/3[5r*.-irIl-  -^2-  )+Op(i)l 

o n 


(2.3) 


for  i = 1 . 2, . . . ,n  and 


(b)  n l (Y  - Y)2  = S4/3  ( ^ ~2  A - 1 1 * °jb  } . 

i=l  1 9(n-lj  S’ 


P * 


(2.4) 


where  S2  = - T (X.  - X)2  and  m = - Y (X.  - X)4  . 
n .“j  x ' 4 n ,t,  1 


n 

l 

i = l 


(a)  Proof.  The  variable  defined  in  (2.1)  can  be  expressed  as 


ri  = [ n(.^(Xj  ‘ X)2  ‘ (Xi  ' x)2)l1/3 


S2/3  [1 


1 <Xi  - X>  j 1/3 


(n-1)  s2 


2/3  1 (Xj-X)  j 

■s  * V?1  1 


(2.5) 


n 


Hence  Y = \ Y./n  = S2/3[l  - (3(n-l))_1  ♦ 0 (1/n2)]  and 

i=l  1 P 


Y.-Y  = S2/3f (3(n- 1) ) _1 (1  - (X.-X)2  / S2)  ♦ 0 (l/n?)] 


(b)  From  (a)  we  have 
n 


n l (Y  - Y)2  = n S4/3{  1 

£ _ 1 1 


i=l  1 9(n-l)‘  i=l  S2  p n2 


n (X  -X)2  2 

2 l f1  - "A ) * 0.A)  > 


4/3  1 1 

n S4/3{  — y [n  - 2n  ♦ — ] + 0 (^)  } 

9(n-lT  S p n 


Mr  2 1 

s4/3{  -S— j f -J  - 1 I ♦ 0 C i ) > . 

9(n-ir  S4  P - 
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Lemma  2.2.  As  n + « 


Uh  - X)0.  - Y)  = - ?(J  J 


n c-4/3 


* "3  + V„>  • 


(2.6) 


1 _ , 

where  m = - £ (X  - X)  . 

j i=1  1 

Proof.  From  Lemma  2.1  (a)  we  have 


- XHV,  - 7,  - s-j/Xi  - ♦ o„  (!*  ; 


p v 2J 

r n 


= S2/3(  1 


(X.-X)2 


30^17  J/h  -XH  1 --^2-)  + °P  & 


I (X.-X)3 

— 1 s2//3r  - * 1+0 

3(n-l)  S ( .2  > + °p  rr 


3(n-l) 


n <T4/3  m 4.  n r1^ 

S m3  °p  (n>  ‘ 


Theorem  2.3.  If  = EX  < ® , for  1 £ k ^6,  then  as  n + « the 
correlation  coefficient  r in  (2.2)  is  asymptotically  normally  distributed 
with  mean 


E(r)  = - 


e 


i 


and  variance 


Var(r)  = 


VV1  vTv1 


U6  - 6p4  - + 9 

(w*  - l)n 


(2.7) 


( S3  - - 6 ) / n , (2.8) 


where  8^  = u^/ (y^  - 1),  8j  and  are  respectively  the  coefficients  of 
skewness  and  kurtosis. 


Proof.  Let  T = (-3  S4/3((n-l)/n))  £ (X. -X) (Y. -Y)  . Then  from  Lemma  2.2, 

i=l  1 1 
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we  see  that  = m^  ♦ 0^(l/n).  It  is  well  known  (see,  for  example,  Cramer 

(1946)  p.  365)  that  the  thirl  central  moment  m,  is  asymptotically  normal 

2 

- pj  + 9)/n.  Hence  is  asymptoti ca’ 1 / 


with  mean  u,  and  variance  (u, 

3 6 

normal  with  the  same  mean  and  variance  as  Now 


r = T [-3  S 
nl 


4/3 


(2.9) 


Hency  by  Slutsky's  theorem  and  Lemma  2.1  (b) , r is  asymptotically  normal  with 
mean  -u3  I = -Bj  / and  variance  (h6  - 6u4  - ♦ 9)/(n(u4-l)  = 

(83  - / (B2-l)  ♦ 3/(e2-l)  - 6)/n  . 

1 

Corollary  2.4.  If  X^,  X2,  ...  , Xfl  are  independent  and  identical  normal 
random  variables  then  r is  asymptotically  normally  distributed  with  mean  0 
and  variance  3/n. 


Theorem  2.5.  (Consistency).  The  test  based  on  the  correlation  coef- 
ficient r is  consistent  against  all  asymmetric  alternatives  with  first  four 
moments  finite. 


n _ 2 

Proof.  In  view  of  Lemma  2.1  and  Lemma  2.2,  / n £ (Y.-Y)  and 

v i=1  1 

1 (X.-X)(Y.-Y)  converge  in  probability  to  /p  -1  / 3 and  -p,/3 , respectively , 
i = l 1 1 V 4 


as  n ■*  « , Consequently  the  correlation  coefficient  r converges  in 
probability  to  -p3  / Jv^-1  • Because  the  critical  constant  of  the  test 
converges  to  0 as  n + “ , the  test  based  upon  r is  consistent  for 
alternatives  with  p3  / 0 . 


Remark  2.6.  From  the  asymptotic  distribution  of  r given  in  Theorem 
2.3,  it  can  be  seen  that  the  test  is  asymptotically  unbiased  against  symmetric 
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2 

alternatives  provided  - 8^  / (B?-l)  * 3/(89-l)  -6  > 3.  It  also  follows 
that  the  test  is  not  consistent  against  symmetric  alternatives. 


Asymptotic  Distribution  of  Z.  It  is  well  known  that  in  samples  of 
moderate  size  from  a bivariate  normal  population  the  product  moment  correla- 
tion coefficient  is  very  nonnormal,  but  the  distribution  of  its  Fisher  trans- 
form Z is  practically  normal  for  remarkably  small  values  of  the  sample 
size.  In  view  of  the  robust  nature  of  this  phenomenon,  and  marginally  near 
normal  distributions  of  and  , the  observation  may  be  expected  to  remain 
valid  in  case  of  the  statistic  r defined  in  (1.2)  especially  when  the  null 
hypothesis  Hq  is  true.  Hence,  we  propose  using 

Z = I log  T^r  (2‘10) 

as  the  test  statistic  and  rejecting  the  normality  of  the  X's  if  |z|  > constant. 


Theorem  3.  Under  the  conditions  of  Theorem  1,  as  n + ••  the  statistic 
Z is  asymptotically  normal  with  mean 


F.(Z) 


V1  + e 


1) 


and  variance 


Var(Z) 


V1 


V6!-1 


,e3  " 1 


V1 


- 6 . / n 


(2.11) 


(2.12) 


Proof.  The  result  follows  from  Theorem  2.3  and  the  well  known  convergence 
theorem  due  to  Mann-Wald  (see,  Rao  (1973)  p.  385),  which  states  that  g(T)  is 
asymptotically  N(g(9);  (g1 (0)  o (T) ) 2)  if  T is  asymptotical ly  N(G,  o2(T)). 

In  the  present  case  T = r,  g(T)  = Z,  and  g' (0)  = 1/(1 -62),  where 


0 = E(r)  = T . 
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Corollary  2.  If  X^X^...^  are  independent  and  identical  normal 
madom  variables,  then  Z is  asymptotically  normally  distributed  with 
mean  0 and  variance  3/n. 

3.  AN  ADJUSTMENT  OF  VARIANCE  OF  THE  NULL  DISTRIBUTION  IN 
SMALL  SAMPLES  AND  A MONTE  CARLO  POWER  STUDY 

Mudholkar  and  Lin  [4],  using  an  extensive  Monte  Carlo  study  for 

the  null  distribution  of  Z in  small  samples,  have  demonstrated  that  the 

statistic  Z can  be  regarded  as  practically  normally  distributed  with  mean 

zero  and  standard  deviation  expressed  as  in  (1.3).  This  expression  of 

is  inappropriate  when  the  sample  size  n is  large  because  it  is 

0(l/n^)  asymptotically.  The  large  sample  theory  of  the  Z-test  developed 

in  Section  2 is  now  used  to  adjust  the  expression  for  so  that  it  agrees 

with  its  asymptotic  value.  Toward  this  end  a polynomial  regression  of 
2 

CTn (Z) , obtained  in  [3]  by  simulation  for  various  values  of  n , is  performed 
by  taking  the  asymptotic  variance  3/n  as  the  leading  term.  The  analysis 
yields 

_2  _ :2,„  3 7.324  53.005 

°n  • °„<Z)  - if r * — • (3'1) 

n n 

A Monte  Carlo  experiment  is  conducted  with  a view  to  comparing  the 
power  of  the  Z-test  with  the  powers  of  the  other  well  known  tests  for  norm- 
ality. In  this  experiment,  1000  samples  each  of  size  n = 20  are  obtained 
by  simulation  from  a broad  class  of  alternative  distributions  which  includes 
both  symmetric  and  asymmetric,  light-  and  heavy-tailed  distributions.  The 
Z-test  using  the  new  formula  for  on  in  (3.1)  at  5%  level  of  significance  is 
performed  on  each  of  the  samples  inorder  to  estimate  its  power  at  these 
alternatives.  The  power  values  of  the  Z-test,  along  with  the  corresponding 
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values  for  competing  tests,  are  presented  in  Table  1.  Some  of  tie  values  of 
the  power  functions  are  taken  from  Filliben  [2],  and  the  remaining  are 
estimated  by  us  on  the  basis  1000  samples. 

From  the  table  it  may  be  concluded  that  the  Z-test  is  superior  to  or 
comparable  with  other  tests  against  asymmetric  distributions  and  is  fair 
against  heavy-tailed  symmetric  alternatives  and  poor  in  detecting  light- 
tailed symmetric  distributions. 


Table  1 

Power  Functions  of  Some  Tests  for  Normality 
n = 20,  a = 5% 


Population 

Skewness 

*1 

Kurtosis 

B2 

KS 

CM 

K3 

W 

W' 

R 

bl 

Z 

Uniform 

0 

1.8 

.09 

.14 

.42 

.15 

.04 

.04 

.01 

.04 

Tukey  (.25) 

0 

2.539 

.05 

.05 

.06 

.01 

.01 

.01 

.02 

.03 

Logistic 

0 

4.2 

.10 

. 13 

.05 

.07 

.12 

.12 

.13 

.12 

Laplace 

0 

6.0 

.23 

.29 

.10 

.26 

.33 

.33 

.24 

.23 

Cauchy 

0 

— 

.84 

.88 

.74 

.89 

.91 

.92 

.79 

.70 

Weibull  (10) 

- .638 

3.57 

.12 

.14 

.10 

.14 

.15 

. 16 

.18 

.15 

Exponential 

2.0 

9.0 

.59 

.73 

.85 

.86 

.82 

.82 

.71 

.83 

Gamma  (2) 

1.414 

6.0 

.32 

.41 

.44 

.50 

.48 

.50 

.45 

54 

Gamma  (3) 

1.155 

5.0 

.24 

.32 

.28 

.33 

.32 

.33 

.37 

.43 

Beta  (2,1) 

- .566 

2.40 

.15 

.21 

.43 

.35 

.18 

.20 

.10 

.22 

KS: 

Ko 1 mogoro v -Smirnov 

W : 

Shapiro-Wilk 

b : Sample 

Skewness 

CM: 

Cramer-von  Mises 

W' : 

Shapiro-Francia 

K,: 

Vasicek 

R : 

Filliben 

Z : New  test 

Figure  1 Scattergram  of  Mean  (down)  versus  Sample  Size  N (across) 


Each  point  is  based  upon  1000  values 


Figure  2 Scattergraa  ot'  Skewness  (down)  versus  Sample  Siie  N (across) 


r 


i 

i 
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Each  point  is  based  upon  1000  values 


Figure  3 Scattergram  of  Excess  of  kurtosis  (down)  versus 
Sample  Size  N (across) 


Each  point  is  based  upon  1000  values 
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APPENDI X : FOR TRAN  ROUTINE  EUR  COMPUTING 
THE  P-  VALUE  OF  2-STATISTIC 
SUBROUTINE  2TEST<  X.N.U,  V.2.P) 


THIN  SUBROUTINE  COMPUTER  THE  P- VALUE  OF  A- TEST  FOR  NORMALITY 
USAGE  CALL  2TEST< X , N ,2 , P) 

X INPUT  VECTOR  OF  LENGTH  N CONTAINING  THE  SAMPLE 

OBSERVATIONS  ■ 

N HUM  HER  OF  SAMPLE  OBSERVATIONS 

U NONE  AREA  OF  LENGTH  N 

V NONE  AREA  OF  LENGTH  N 

2 SAMPLE  VALUE  OF  2-STATISTIC 

P P- VALUE  OF  2-STATISTIC 

REQUIRED  ROUTINES  € FUNCTIONS 


SUM<  X.N) 

FUNCTION 

SUBPROGRAM 

TO 

GIVE 

THE 

SUM 

OF 

X 

SUMSQ< X.N) 

FUNCTION 

SUBPROGRAM 

TO 

GIVE 

THE 

SUM 

SQUARE  OF  X 

CRUS  PH  < X.X.N) 

FUNCTION 

SUBPROGRAM 

TO 

GIVE 

THE 

SUM 

OF 

PRODUCT 

OF  X AND 

X 

NORMALi  X.X.P) 

SUBROUTINE  TO  GIVE 

THE 

ORDINATE 

X AND 

THE 

PROBABILITY  P OF  THE  STANDARD  NORMAL  DISTRIBUTION 
AT  X AND  MAX  BE  SUBSTITUTED  BX  COMPARABLE  ROUTINE 


DIMENSION  X<  N)  ,U(  N)  ,V(  N) 

S-SUMl X.N) 

SSQ*SUMSQ( X.N  ) 

DO  10  I-l.N 
U<I)  = S-Xd) 

Vd)*(SSQ-X<I)*X(  I)-U<  I)*U(I)/(  N-l)  )**(  1.  /3.  ) 

CORR * ( CROSPR ( U . V , N ) -SUM< U,N) *SUM<  V,N)/N)/ 

If ( SUMSQ<U ,N)-SUM<  U ,N)**2/N)*( SUMSQ<  V,N)-SUM < V,N)**2/N)) 
2**.5 

2*0 .S*AL0G(  f ltC0RR)/(  1 -CORR)) 

SIGMA*(  3 . 0/n-7 . 3 2 4/J7**2  + 53 . 005/ff**3  )**0 . 5 
GAMMA2*-11 ,697/#+55.059/W**2 
2N*ADS<  2/SIGMA) 

CA lL  NORMAL < 2N.X.P) 

P*2.  -2.  *f  P-GAMMA2*(  2N *Z N *2N- 3*2 N ) * X / 2H  . ) 

RETURN 

END 


FUNCTION  SUM (X.N) 
DIMENSION  X<N) 

SUM*0 . 

DO  10  1*1.  N 
10  SUM*SUM*Xd ) 

RETURN 

END 

C 

FUNCTIO N SUMS 0 < X.N) 
DIMENSION  X(  N) 

SUMS Q*Q. 

DO  10  1*1 ,N 

10  SUMSQ*SUMSQ+XU)*X< I) 

RETURN 
END 


C 
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FU MOTION  CRUS  PH  ( X,  X , N ) 

OI'AEUSIOU  X(N).nU) 

CMOS  PH*  0 . 

UU  10  I*  1,11 

10  CROSPR*CRQSPR  + X(  I)*K  I) 

RETURU 

BUD 

C 

SUHROJTIME  NORM  AH X,X.P) 

(f*l«  1283792  *EXP(  -<  X*X/2.  )) 

1*0/ 2.82842712 
Ma/ttSf  X) 

IF( XA.uT.2. 5 ) yo  70  2 

l/*l«/(  *A+1.  /f  */t+2  . / I £/l+3./l*/l+4.  / I */t  + 5 . /r  */l  + 6 . /C  *4  + 7 . / f *4  + 8 . / ( X/1  + 9 
1.  /1&4+10./1  XA+ll.  /f  ZA+12. /XA)) ))))))))  )) 

IF< X.GE.O)  QU  TO  1 
Pat/*/ 

GO  TO  * 

1 P»  !.-£/*/ 

(,’o  ro  *♦ 

2 iTa  1.4.14  21  06  /c  1.414  2136  + 0. 32  75911*^/1) 

(;*(;*!  ((  10.94064607  *ET-1 .28782245)*£’Z,+ 1.2596513  ) *ET-0 . 2 5212  8668  )* 
l£?+0.22563bB46 ) *ET 
IP< X.GE.O)  GO  TO  3 
Pat// 2. 

GO  TO  * 

3 P*l.-<//2. 

4 RETURN 
BUD 


API  FUNCTION  FOR  COMPUTING  TRE  P-VALUE  OF  Z-STATISTICS 


X : ItfPI/r  VECTOR  OF  SAMPLE  OBSERVATIONS 

Z:  SAMPLE  VALUE  OF  Z- STATISTIC 


7 P-ZTEST  X 

Cl]  7«-(((+/X*2)-(X*2))-(tf*2)»!7-l)*(l*3)*  0*(  ♦/*)-*• 

[ 2 ] /?«■(  (+/ y*  P)-(  + /£/)*( +/P)  +/f  )♦(((  + /f/*  2 )-((+/ 7)  *2  )*/')a(+/T/*  2 )-((+/V)*2)*W)*0. 5 
C 3 ] Sr/717i4«-((  3 . 0 ♦ '0  + ( ”7 . 3 24*tfx// ) + 5 3 . 0Q5*N*N*N  )*0 . 5 
C 4 ] GA’fMA  2+-(  ”ll  .697*W)  + 55.059$/7*2 
C 5 ] Z«-0.5**(1+P)U-/? 

C 6 ] ZN*-\Z*  SIGMA 
C 7 ] <S')£0>10  PUBLIC  .STAT : NORM1 

C 8]  NPROB+(nORM  ZN)-(l*2*)*OAMMA2*((  ZN*3  ) - 3 *Z<7 ) * ( 2 . 71 9 281 3 2 8*(  - ( ZN*2  )*2  ) ) *(o  2)*. 
[9]  P-*-2-2*nPR0B 
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